Journal: AMIA Annual Symposium Proceedings

Article Title: Inter-Rater Agreement Among Physicians on the Clinical Significance of Drug-Drug Interactions

doi:

Figure Lengend Snippet: Inter-rater agreement results

Article Snippet: The inter-rater agreement results are presented in . table ft1 table-wrap mode="anchored" t5 caption a7 Physician Group Fleiss Kappa (95% confidence interval) Wolters Kluwer Health (n=8) 0.19 (0.12, 0.26) Palo Alto Medical Foundation (n=8) 0.22 (0.14, 0.29) Combined (n=16) 0.21 (0.15, 0.27) Open in a separate window Inter-rater agreement results For a randomly selected interaction reviewed by the combined group of sixteen physicians, there was a 62.12% chance that two physicians would agree on whether or not the interaction was clinically significant.

Techniques:

Journal: International Journal of Industrial Ergonomics

Article Title: Usability of state public health department websites for communication during a pandemic: A heuristic evaluation

doi: 10.1016/j.ergon.2021.103216

Figure Lengend Snippet: Assessment agreement consistency ratings and Fleiss Kappa Rates.

Article Snippet: Minitab's Fleiss Kappa analyses computed the incidences of agreements and assigned it a strength of assessment agreement for each usability criterion – we then summed all the incidences for each category of agreement strength; for example, the five of us had an almost perfect agreement on 61 of the 148 criteria across all states.

Techniques: